PROBABILISTIC AND COMBINATORIAL ASPECTS OF 
THE CARD-CYCLIC TO RANDOM INSERTION SHUFFLE 

ROSS G. PINSKY 

Abstract. Consider a permutation a € Sn as a deck of cards num- 
bered from 1 to n and laid out in a row, where aj denotes the number 
of the card that is in the j-ih position from the left. We study some 
probabilistic and combinatorial aspects of the shuffle on 5„ defined by 
removing and then randomly reinserting each of the n cards once, with 
the removal and reinsertion being performed according to the original 
left to right order of the cards. The novelty here in this nonstandard 
shuffle is that every card is removed and reinserted exactly once. The 
bias that remains turns out to be quite strong and possesses some sur- 
prising features. 



1. Introduction and Statement of Results 

Let Sn denote the symmetric group of permutations of [n] = {1, • • • , n}. 
Our convention will be to view a permutation cr G Sn as a deck of cards 
numbered from 1 to n and laid out in a row, where aj denotes the number 
of the card that is in the j-th. position from the left. In this paper, we analyze 
the bias in the following "shuffle" on n cards: remove and then randomly 
reinsert each of the n cards exactly once, the removal and reinsertion being 
performed according to the original left to right order of the cards. The 
novelty here in this nonstandard shuffle is that every card is removed and 
reinserted exactly once, unlike in any of the shuffles one encounters in the 
literature. The point is to see how much bias remains when one knows that 
every card has been removed and reinserted. 
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We dub this shuffle the card-cyclic to random insertion shuffle. The reason 
for this terminology along with the original motivation that led to the study 
of this shuffle will be explained at the end of this section. However, we feel 
that the results are of independent interest regardless of that motivation. 

We let Pn(<7) t) denote the probability that the deck ends up in the state 
T E Sn, given that it began in state a G S'„. Of course, since the shuffle 
is transitive, it suffices to look at i?„(id, •), where id is the identity element, 
corresponding to the cards being in increasing order from left to right. Note 
that if n > 3, the distribution after one such shuffle can not be exactly 
uniform because there are n" equally probable ways to implement the shuffle, 
but there are n! possible states of the deck, and n! f n". Of course this 
doesn't rule out asymptotic uniformity, but in fact we shall see that the 
card-cyclic to random insertion shuffle is far from uniform. 

We begin with the behavior of the distribution of the card in the first 
position and of the card in the last position. The bias with regard to the 
first position turns out to be quite strong. 

Theorem 1. Under Pn{id, ■) , the random variable ai, denoting the number 

of the card in the first position, has the following behavior: 

i. 



(1.1) lim npn{id, {ai = 6„n}) = e'^ ^, if lim bn = b E (0, 1]. 




In particular then, defining the probability measure on [0, 1] by 



iy^{A) = pn{id, {(71 G nA}),A c [0, 1], 



one has 



w — limn^oo^^{dx) = e ^5q{x) + e^ ^dx. 



hm npn{id, {ai = bnu}) 




(1.2) 



if lim bn = 



and liminf 



n-^oo y^logn 



bn > V2. 



m. 
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lim n2pn{id,{ai = dnn^}) = / e~^dy, 

(1.3) 

if lim dn = d £ [0,oo]. 



d 



In particular then, defining the sub-probability measure /i^ on [0, oo) by 
H^{A) =pn{id,{ai G ni^}),^ C [0,oo), 

one has 

w— lim = ( / e''^dy)dx, 

the total mass of the measure on the right hand side above being e~^ . 

Remark 1. From Theorem [T| it follows that the most likely numbers for the 
first position lie "right next to" the least likely numbers. More precisely, the 
following facts follow from Theorem [Tj 

1. (Most likely asymptotic numbers for first position) Let {7n}^i denote a 
sequence satisfying 1 < ^ n, for each n. Then 



sup limsupn2p„(id, {cJi = 7n}) 



oo 2e 



In particular, the supremum is attained for sequences {7n}^i satisfying 
7„ = o(n5). 

2. (Least likely asymptotic numbers for first position) Let {7n}^i denote 
a sequence satisfying 1 < 7n < for each n. Then 

inf liminf np„(id, {(Ti = 7nl) = e~^ . 

In particular, the infimum is attained for sequences {'yn}^=i satisfying 7„ = 
o(n) and 7„ > {\/2 + e)n2 ylogn, for some e > 0. 

Remark 2. Note that the boundary layer between p„(id, {cJi = j}) being 
on the order n~2 and being on the order is the narrow strip where j is 
on a larger order than na but on an order no larger than na logn. 

The bias with regard to the last position is considerably tamer than the 
bias with regard to the first position. 
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Theorem 2. Under pn{id, •), the random variable an, denoting the number 

of the card in the last position, has the following behavior: 

i. 

e^ 

(1.4) hm npn{id, {o-„ = 6„n}) = if lim bn = b € [0, 1). 

n— >oo e — i n— >cxD 

In particular then, defining the probability measure u!^ on [0, 1] by 
u^{A) = pn{id, {an G nA}),A C [0, 1], 

one has 

w — linin^ooi^n (dx) = -dx. 

ii. 

(1.5) 

lim npn{id,{an = bnn}) = , if lim 6„ = 1 and lim [n — bnu) = oo; 

n— >-oo e — 1 n— ^oo n— >oo 

Hi. 

e — 6~' 

(1.6) lim npn{id, {an = n - I}) = — , / = 0, 1, • • • . 

n— ^-oo e — i 

Remark. The following facts follow from Theorem [2} 

1. (Most likely asymptotic numbers for last position) Let {7^}^^! denote a 
sequence satisfying 1 < 7}i < n, for each n. Then 

sup limsupnp„(id, {fT„ = 7„}) = -. 

{7n}^=l e - i 

In particular, the supremum is attained for sequences {7n}^i satisfying 
lim„^oo ^ = 1 and lim„_>oo("- - Jn) = 00. 

2. (Least likely asymptotic numbers for last position) Let {'yn}^=i denote a 
sequence satisfying 1 < ^ n, for each n. Then 

inf liminf np„(id, {(T„ = 7„}) = . 
{7n}5r=i "^00 e-1 

In particular, the supremum is attained for sequences {7^}^^ satisfying 

7n = o(n). 

Theorem [l] showed that the cards with numbers on the order na are 
more likely to occupy the first position than cards with larger numbers. In 
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fact, more generally, cards with numbers on the order na are more likely to 
occupy any position at the beginning of the deck than are cards with larger 
numbers. We can quantify this and use it to prove that the total variation 
norm between the card-cyclic to random insertion shuffle measure and the 
uniform measure converges to 1 as n — >■ oo. Recall that the total variation 
norm between two probability measures fj, and v on Sn is defined by 

- u\\ty = sup iniA) - u{A)) = J V \n{a) - u{a)\. 

Theorem 3. Let 

■^^ML = W ^ Sn '■ Cj < Mn^ , for some j < L} 

be the event that a card with a number less than or equal to Mn^ appears 
in one of the first L positions. Then for sufficiently large C, 

(1.7) lim lim. pn{id,A^^ ^^2) = 
In particular then, 

(1.8) lim \\pn{td,-)-Un\\TV=l- 

The first two theorems dealt with the distribution of the number of the 
card in special positions — namely, the first and the last positions. We now 
consider the distribution of the position of the card with a general number. 

Theorem 4. Under Pn{id, ■) , the random variable cr^^^' denoting the posi- 
tion of card number hnU, has the following behavior. A ssume that lim^j—^Qo ~ 
6 G [0, 1]. Then the weak limit of the distribution of ^cr^^n ^a^isis. Its distri- 
bution function 

Fb{x) = lim pn{id, {aT^ < xn}), x G [0, 1], 

is given as follows. Define Gb : [0, 1] — > [0, 1] by 

\ye^-\ 0<j/< l-(l-6)e^ 

Gb{y) = { 

e(i-f)^ - (1 - y)e^-^ 1 - (1 - h)e^ <y<l. 
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Then Fb = Gl. 

A calculus exercise gives the following corollary of the theorem. 

Corollary 1. Let fh denote the density of the distribution function Ff,, that 
is, the density function for the limiting rescaled position of a card with a 
number around bn. Let = e^^^ ~ (1 ~ b)e. Then fi = 1, and for b G [0, 1), 
i. fh{x) = e^"\ < X < Xb; 
^i- fb{xt) = 

Hi. fb{x) is decreasing and convex for x G {xb, 1]; 
^v. fb{l) = ^.. 

Remark. The corollary shows that for a card with a number around 6n, 
with b G (0, 1), the most likely positions in which it will end up are those 
just to the right of nxb = n{e^^^ — (1 — b)e), and the least likely positions 
are all of those less than nxb- In particular, the most likely positions for a 
card with a number around bn lie "right next to" the least likely positions. 
See figure [T] Note also that /o(0) = oc, which means that for all b and d, 
the probability of a card with a number around bn ending up in a position 
around dn is the greatest for b = d = 0. (This connects up with Theorem 
[ij) The probability measures corresponding to the densities fb are weakly 
continuous with respect to 6 G [0,1]. For each b G (0,1), the density fb 
has a discontinuity, however considered as cadlag functions, the densities fb 
vary continuously in the Skorohod topology for & G (0, 1). This continuity 
does not extend to 6 = 0, where /o(0) = oo, or to b = 1, where /i = 1 but 
linife^i sup^.g[o,i] Mx) = 

Let ii^P"^''^'') denote the expectation corresponding to the card-cyclic to 
random insertion shuffle starting from id, so that E^"^^^'^''^a^\.^ is the expected 
position for card number 6„n at the end of the shuffle. It follows from the 
theorem that if lim„_!.oo bn = b, then E(b) = lim„_^oo hEP"^^'^''^ar\ exists 
and is given by /o^(l — Fb{x))dx. Making a substitution and integrating 
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b= 1/4 b= 1/2 b= 3/4 




Figure 1. Density for limiting rescaled position of a card 
with a number around bn. 

by parts shows that this integral is equal to Jq Gi){y)dy. Computing this 
integral then gives the following corollary. 

Corollary 2. Let E{h) = hm„^oo k^^"^"^''''^br!n' where hm„^oo &n = b, de- 
note the rescaled limiting expected position for a card with a number around 
bn. Then 

E{b) = eb+^e^-''-e''. 

The function E{b) has the following properties: 
i. E{0) = le - 1 « .359; 
It. E{1) = \; 

Hi. E{-) increases for b E [0,6*] and decreases for b € where b* w .722 

is the solution to e — — \e^^^ = 0. The maximum value of E{-) is 
E{b*) « .564; 

iv. E{b) > b, for b G [0, b] and E{b) < b for b e [b, 1], where b ^ .545. 
V. j^E{b)db=\. 

Remark. In particular, a card starting out very near the left end of the deck 
will end up on the average around 35.9 percent of the way through the deck, 
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Figure 2. Limiting rescaled expected position of a card with 
a number around bn. 

while a card starting out anywhere else will end up on the average further 
to the right than this. A card starting out around 72.2 percent of the way 
through the deck will end up on the average around 56.4 percent of the way 
through the deck, while a card starting out anywhere else will end up on the 
average further to the left than this. A card in the first 54.5 percent of the 
deck will end up on the average further to the right than where it started, 
while a card in the last 45.5 percent of the deck will end up on the average 
further to the left than where it started. See figure [2] But of course, as 
(v) indicates and as is clear from considerations of symmetry, the average 
ending position of the average card must be the 50th percentile. 

The following corollary shows that the random positions of a finite number 
of cards are asymptotically independent. The result follows easily from the 
proof of Theorem [4j as will be shown after the proof of that theorem. 

Corollary 3. For m > 1, let 1 < 6i„n < b2nn--- < bmnn < n satisfy 
liuin^oobjn = bj £ [0,1]; so < bi < 62 < ••• < &m < 1- Then under 
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Pn{id, •), the distribution of the random vector (o';^^^, '''fejln' ' ' ' ' "^fe^nn) 
verges to the m- dimensional product distribution with density HJli fbj{xj), 
where x = (xi , • • • , Xm) ■ 

We can use the above corollary to say something about the probability of 
inversions. For i < j, if card number j appears to the left of card number i 
in a permutation o", then we say that the pair of cards with numbers i and 
j form an inversion for the permutation a. This concept is described more 
fully below, two paragraphs above Lemma [T| For m = 2 in Corollary |3| let 
(S^^^jSg^^^) denote a random vector distributed according to the density 
/fci (a;i)/fe2 (^2)- We will prove the following result. 

Corollary 4. i. Let b ~ .768 be the root of the equation (1 — b)e^ — ^ = 0. 
Then 

P{Ti^^^ < ^2^^,^) > for bi < b2 < b and 62 sufficiently close to 61; 
P{T,^.l_^ < S^^^) < -, for 6 < 5i < 62 and 62 sufficiently close to bi; 

ii. Let b ~ .380 be the unique root of the equation E{b) = ^, for b G [0, 1), 
where E{b) is as in Corollary^ Then 

P(S-] < > ^, /or 6 e [0,5); 
P(S-i < < ^, /or 6 G (6,1). 

Remark. The first part of the corollary indicates that for large n, if one 
takes a card with a number around bin and a card with a number around 62^, 
with 62 > bi and sufficiently close to 61, then under p„(id, •), the probability 
that these cards form an inversion is less than ^ if 61 < 6 ~ .768 and greater 
than ^ if 5i > 6 ~ .768. (We suspect that the restriction that 62 be close 
to bi is unnecessary for the above result.) The second part of the corollary 
indicates that for large n, if one takes a card with a number around bn, 
6 G (0, 1), and a card with a number around n (that is, a card from the very 
end of the deck), then under Pn{id, •), the probability that these cards form 
an inversion is less than ^ if 6 < 6 and greater than ^ if 6 > 6. Furthermore, 
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the point b = b where the probabiUty is equal to ^ is exactly the point b 
where the limiting average rescaled position E{b) is equal to |. Despite the 
above corollary, the measure Pn(id, •) favors permutations that do not have 
a lot of inversions, in a sense made precise in Corollary [6] below. See also, 
the remark after that corollary. 

The results in Theorems [T] and [2] are local limit theorems. If we had such 
a local result in Theorem|4| namely lim^^oo ^Pni^d, {o"^^^ = [xn]}) = fb{x), 
rather than only 

(1.9) „l™o^'"(i^' ^ ^^}) = ^f'(^)' 

then it would follow easily that if lim„_s.oo Xn = x, then lim„_j.oo Pn(id, {(yx„n < 
bn]) = fb{x)db. Unfortunately, we don't see how to prove this rigorously 
just from ( |1.9[ ), nor do we see how to prove directly that lim„_i.oo Pn.(id, {(Tx^n < 
bn}) exists; although it is intuitively obvious that it does. And if it does ex- 
ist, then it is easy to show that the corresponding density must be hx{b) = 
fb{x). This density function hx{b), < 6 < 1, for the limiting rescaled 
expected card number occupying a position around xn, is not useful for ex- 
plicit calculations as is fbix), the density function for the limiting rescaled 
position of a card with a number around bn. However, we can give its basic 
behavior, like we gave the basic behavior of fb{x) in Corollary [l| We will 
prove the following result concerning the behavior of hx{b) = fbix). 

Corollary 5. The density function hx{b), the limiting rescaled card number 
occupying a position around xn, has the following behavior. 

For X = 0, one has ho^b) = e''~^,0 < 6 < 1. This is a sub-probability 
density with total mass 1 — e~^ . In addition there is a 6-mass of size e~^ at 
6 = 0. 

For X = 1, one has hi{b) = < b < 1. 

Let bx, < X < 1, denote the inverse of the function Xb = e^~^ ~ (1 ~ b)e. 
For < X < 1, one has 
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ii. hx{b) is increasing and convex on < b < bx; 

Hi. hx{bx) = jz^; 

iv. hx{b) = e''-\ bx<b<l. 



Remark. The fact that at x = there is a 5 mass at of size e connects 
up with Theorem [T] The corollary shows that the most likely numbers to 
find in a position around xn, < x < 1, are numbers slightly smaller than 
nbx- If e''^ < 2, or equivalently, x < — (1 — ln2)e w .525, then the 
least likely numbers to find in a position around xn are numbers slightly 
larger than nbx', if x > — (1 — ln2)e, then the least likely numbers to 
find in a position around xn are numbers on order o(n). In particular, for 
all X £ [0, 1], the most likely numbers for a position around xn are "right 
next to" numbers that are much less likely to be in such a position, and 
if X < ^e — {1 — ln2)e ~ .525, then these latter numbers are the least 
likely ones to be in such a position. See figure [3j The probability measures 
corresponding to the densities hx are weakly continuous with respect to 
X G (0,1], and the densities hx, considered as cadlag functions with the 
Skorohod topology, vary continuously for x G (0, 1]. 
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We now turn to the study of the entire distribution pn{id, •). We need 
to introduce some additional concepts and notation. Fix a positive integer 
n. Let / = (/i, • • • ,/n-i) be an (n — l)-vector of positive integers satisfying 
i < li < n — 1. Consider the cohection of all integer- valued paths {1^}"^^ 
satisfying 1 < Yi < Y2 ■ ■ ■ < Yn = n, with the strict inequality Yi+i > Yi 
holding if li < /j. Note that one always has Yi > i, for alH = 1, • • • ,n. Call 
such paths nondecreasing l-paths of length n. Denote the number of such 
paths by Nn{l)- Note that Nn{l) is strictly decreasing in each of its n — 1 
variables. 

Recall that for a £ Sn and [n] with i < j, the pair is called an 

inversion for a if aj < Cj. According to our convention, is an inversion 
for a if the card in position i has a higher number than the card in position 
j. Thus, is an inversion for the inverse permutation if the card 

numbered i appears to the right of the card numbered j in the permutation 
a. In this case, as we have already noted before Corollary[4j we also say that 
the cards with numbers i and j form an inversion for a. For 2 < j < n — 1 
and a £ Sn, let 
i-i 



involving the card numbered j and a card numbered less than j. 
Define l{a) = (/i(cr), • • • , /„_i((t)), where Z„_i(cj) = n — 1 and 



Note that j < <n — 1, j = !,••• ,n — 2. 

Lemma 1. For each I = (h, - ■ ■ , In-i) satisfying j < Ij < n — 1, for j = 
1, • • • ,n — 1, there exist exactly n permutations a £ Sn satisfying 1(a) = I. 

Proof. Note that 1(a) does not depend on a~^, the position in a of the card 
numbered n. It is easy to see that any a G Sn is uniquely determined by 
the value of a~^ and by the condition 1(a) = I, where I = (li, ■ ■ ■ , In-i) is 
as in the statement of the lemma. □ 




k=l 



hi^) = j + In~j(cr), i = l,••• 



n - 2. 
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Theorem 5. Let a G Sn- One has 

iVn(/(a)) 
Pn{td,a) = ^„ 

where Nn{l) denotes the number of nondecreasing l-paths of length n. 

Theorem [5] gives a qualitative picture of the nature of the bias in the 
p„(id, •)-shuffle. Indeed, using the strict monotonicity of N{1) and the defi- 
nition of 1{(t), the following corollary is immediate from Theorem [5] 

Corollary 6. i. Pn{id, a) does not depend on cr~^ , the position in a of card 
number n; 

a. Let a', a" G S'„. If Lj{a') < Ij{a"), for all j e {2, ■ ■ ■ ,n - 1}, then 

Pn{id,(j') > pn{id,a"), 
with a strict inequality holding if I j {a') < I j {a"), for some j G {2,--- ,n— 1}. 

Remark. Of course, we don't need the theorem to get part (i) of the corol- 
lary. From the definition of the shuffle, it is clear that the distribution of 
card number n is uniform. Part (ii) shows in particular that among cards 
numbered from 1 to n — 1 , if every such pair of cards that forms an inversion 
for a' also forms an inversion for a", then p„(id, cj') > p„(id, fi"). Thus, in 
the above sense, the more a permutation preserves the order defined by id, 
but ignoring card number n, the more it is favored by Pn(id, •). We have 
qualified the above sentence with the words "in the above sense, " because 
Corollary\^ shows that if n is large and 62 > &i > & ~ .768, with 62 dose to 
hi, thenpn{id,-) assigns a probability greater than ^ to those permutations 
for which card number [bin] and card number [b2n] form an inversion! 

It seems quite difficult to estimate Nn{l) for general /. However, the 
maximum and minimum over / can be calculated explicitly. 

Theorem 6. One has 

(1.10) 2"-^ < Nn{l) < ^ 



n + 1 \ n 
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for all I = (/i, • • • , In-i), with j < Ij < n — 1, for j = 1, • • • , n — 1. The 
left hand inequality above is an equality if and only if Ij = n — 1, for all 
j = 1, • • • ,n — 1, and the right hand inequality above is an equality if and 
only if Ij =j, for all j = !,■■■ , n - 1. 



Remark. Note that the right hand term in (1.10) is equal to C„, the nth 
Catalan number. 

The following corollary is immediate from Theorems [5] and [6j 

Corollary 7. One has 

nn-l /'2n\ 

(1.11) —<Pn{td,a)< 



n" {n + l)n" 

The right hand inequality above is an equality if and only if a possesses 
the increasing subsequence {I,-- - ,n— 1}, and the left hand inequality is an 
equality if and only if a possesses the decreasing subsequence {n — 1, • • • ,1}. 

Note that the left hand side of ( |1.11[ ) is and the right hand side of 



(|1.11|) behaves asymptotically as n — )• oo like t~j while the uniform 



probability measure Un{cr) = ^ behaves asymptotically as n — )• oo like 
J — Thus, we have the following tight uniform bounds over a ^ Sn- 

v27rn ^ 

1 + o 1 2 - « < ^" ' / < 1 + o 1 - «, as n ^ oo. 

2 e Un\<y) n e 

In particular, the separation distance between Un and Pn(id, •) approaches 

1 exponentially fast as n — )• oo. (Recall that the separation distance s is 

defined by s(C/„,p„(id, •)) = max^es„(l - ^u^^)-) 

We now pose a question. 

Question. Consider the random walk with increment distribution given 
by Pni', •)• Letting (p„)(™)(id, •) denote the m-fold convolution of Pn(id, •), 
which is the distribution of the random walk at time m given that it started 
from id, how large must {mn}^^i be so that lim„_!.oo ||f^n — (Pn)'"" (id, OIItv 
equals 0, and how small must {m„}^]^ be so that it equals 1? 
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In light of the discussion below, one would expect that m-„ will be on 
the order log n. In order to use Theorem [5] to answer this question, one 
needs good bounds on Nn{l) for general /. This seems to be a quite difficult 
combinatorial problem. It follows from Theorem [5] that this random walk is 
not reversible. 

Corollary 8. The random walk on Sn with increment transition measure 
Pn{id, •) is not reversible. 

Proof. From the formula in Theorem [Sj it is easy to see that the equality 
Pn{id,a) = pn{id, a^^) does not hold for all a G 5„. □ 

We prove Theorems [T]j6] in sections 2-7 respectively. The proofs of Corol- 
laries [3| [4] and [5] are given immediately after the proof of Theorem [4| 

The original motivation for this paper comes from the results on mixing 
times for a number of classical shuffles; in particular, the random to random 
insertion shuffle, a random walk on Sn whose transition is implemented by 
choosing a card at random, removing it from the row, and then reinserting 
it in a random position in the row. Denote this random walk by {Xm}m=o 

(n) 

and let Pa denote probabilities for the random walk starting from a. The 
random walk is irreducible and the uniform distribution Un is its invariant 
measure. It's aperiodic since = a) = I Thus e •) 

converges to ?7„ as m — >• oo. One is interested in the rate of convergence 
in the total variation norm as the parameter n grows. It is known that 
the mixing time is on the order nlogn. A long-standing open problem is 
to establish the cut- off phenomenon; namely to establish the existence of a 
c* such that if > cnlogn with c > c*, then lim„_5.oo \ \Pid \-^rnn ^ ') ~ 
Un\\TV = 0, and if m„ < cn log n with c < c*, then lim„_i.oo W^id'^ (.Xm„ G 
f^nllxv = 1- It has been conjectured that c* = |, and the lower bound c* > | 
has been proven very recently using delicate probabilistic estimates [9] . The 
best know upper bound is c* < 2, which was obtained by analytic methods 
[3. For other similar looking shuffles, such as the random transposition 
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shuffle (where at each stage, two cards are selected independently — so the 
same card might be selected twice — and then their positions are swapped) 
and the top to random insertion shuffte (where at each stage, the current 
top card (left-most card in our setup) is removed and randomly reinserted), 
the cut-off phenomenon has been proven with m„ in the same form as above, 
with c* = ^ and c* = 1 respectively [1]. 

Note that the mixing times of all the shuffles above are on the order 
nlogn. Now recall that the coupon collector's problem is the problem of 
determining how many samples of an IID random variable, distributed uni- 
formly on [n], are required until every number has been selected at least 
once. Denoting the required number of samples by it is well known that 
lim„_i>oo P{Tn > n log n + c„n) equals if lim„_>oo c„ = oo and equals 1 if 
lim„_>oo Cn = — oo. More delicate estimates show that if Tn-k denotes the 
number of samples required until all but k cards are selected once, then 
lim„_>oo P{Tj^ ^ (1 ~ l)nlogn + Cnu) equals or 1 with Cn as above. The 
coupon collector phenomenology is an integral part of the proofs of some 
of the results noted above. This leads one to wonder whether the order 
nlogn for mixing in the above shuffles is caused exclusively by the coupon 
collector's phenomenology, that is exclusively by the fact that one needs 
order n log n shuffles to move most of the cards at least once, or whether 
this order is inherent in these shuffles for additional reasons. (Indeed, after 
order nlogn shuffles, most of the cards have been removed and reinserted 
many times.) It was natural then to consider a shuffle that moved every 
card exactly once. To make such a model as close as possible in spirit to 
the random to random insertion shuffle, one should randomize the order in 
which the n cards are removed and reinserted exactly once. However, this 
seemed intractable, so we were led to study the problem presented in this 
paper, where the order in which the cards are removed and reinserted is 
not random, but rather is the original left to right order of the cards. We 
admit that this is no longer the appropriate model, however, we think the 
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results obtained here are of independent interest. As was noted, the fact 
that n! f n" when n > 3 shows immediately that the distribution of our 
shuffle cannot be uniform after one shuffle. If one randomizes the order in 
which the n cards are removed and reinserted, then this argument breaks 
down. However, even this shuffle does not give the uniform distribution; 
indeed, one can check by hand that for n = 3, the resulting probabilities 
can take on the values ^ and 

The reason we use the terminology card-cyclic is that in the card-shuffling 
literature the term cyclic to random shuffle (by which one means cyclic to 
random transposition shuffle) is used for the shuffle where at step k one takes 
the card currently in position k mod n and transposes it with a random card. 
This kind of shuffle is position-cyclic, whereas ours is card-cyclic. In position 
cyclic shuffles, after one cycle, there are usually many cards that have not 
been moved at all. For results on position-cyclic to random transposition 
shuffles in the spirit of some of the results in this paper, see [6], [8], [3]. For 
results on position-cyclic to random transposition shuffles in the spirit of the 
question we posed above, see and [5j. 

2. Proof of Theorem [T] 

We first derive the exact combinatorial formula for Pn(id, {cri = j}). Of 
course we have Pn(id, {fxi = n}) = ^. Now consider 1 < j < n — 1. If card 
number j is moved to the k-th position, with 2<fc<n — j + then at the 
end of the shuffle it will be in the first position if and only if the following 
occur. Cards numbered 1 up to j — 1, which were moved before card number 
j was moved, must move successively to the right of card number j -\- k — 1. 
If this occurs, then after card number j is moved to position k, the cards 
numbered j ' + 1 up to j ' + A; — 1 will be to the left of card number j. These 
cards numbered j + 1 to j ' + /c — 1 now must move successively to the right 
of card number j. If this occurs, then card number j will be in the first 
position. Now cards numbered j + A; up to n must all move to positions 
greater or equal to two, so that card number j remains in the first position. 
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We now calculate the probability of this occurring. The probability that 
cards numbered 1 up to j — 1 move successively to the right of card number 
j + k — 1 is nz=2 "~"'ra^"''^ • '^^^ probability that cards numbered j + 1 to 
j + k — 1, which occupy the first k — 1 positions, move successively to the 
right of card number j, which occupies the k-th position, is Hfji^ '^^"^^^ The 
probability that cards numbered j + k up to n all move to positions greater or 
equal to two is (itLL^"--i-'i-'+i Thus, conditioned on card number j moving 
to position k, with 2 < k < n — j + 1, the probability that card number j will 
end up in the first position is ^^_^"~^^^^| — . Conditioned on card 

number j moving to position k with k > n — j + 1, the above considerations 
show that the probability of it ending up in the first position is zero. 

Now consider the case that k = 1; that is, j is moved to the first position. 
At the end of the shuffle, card number j will be in the first position if 
and only if the following occur. Cards numbered 1 up to j — 1 may move 
unrestrictedly. Then after card number j is moved to the first position, 
cards numbered j + 1 to n must move to positions greater or equal to two, 
so that card number j remains in the first position. Thus, conditioned on 
card j moving to the first position, the probability that it will end up in the 
first position is (^^^)"~"' - 

From the above considerations and calculations, we conclude that 



1 n-1 (n-lV'"J^'^(n-l)"'~^~''+^ 

(2.1) p„(id,{ai=j}) = -(— r-^ + ^^^ E ^ 



We now prove each of the three parts of the theorem. 
Proof of (in). Consider first the case that j = dnU^ , with lim„_j.oo dn = d £ 
[0, oo). With a small change in notation, the proof also works with d = oo. 



We break up the sum in (2.1) into three parts. Fix a large M. We look 
at the sum as k runs from 2 to [Mnz], from [Mna] + 1 to [^n], and from 
[^n] + 1 to n — J + 1. We begin with the last sum. Let A; = [(1 — c)n] with 
c G (0, ^). By looking at the ratio of two consecutive terms, it follows that 
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for < X < n — 2, the expression ^ ^| ' is increasing in x. Thus, 

(n-l)t (2e)t 
(n-,-A: + l)!^n!I^^7^' " ^ 

Using this along with the fact that ~ ^e~"\/2vrn as n — )• oo, we have 

,2.2) "f' '"-^>":'^" < for large „, 

We now consider the first sum, as k runs from 2 to [Afna]. For k = [cna], 
with c G (0, M], we write 
(2.3) 

(n - j - A; + 1)! ~ 

. n-1 .(n-d„nKc«Ul) dnn^ - ml + 1) (n-d„ni +1) 

n — a^raa — cn2 +1 
As n — 7- oo, we have 



{n — dnTi^ — cn2 + 1) log( 



(n — d„n2 — cn2 + 1)! 
) = 



n — 1 



1 1 
n — dnW^ — cn2 + 1 



(2.4) _ ^^^2 — cn2 + 1) log(l + 



(i„n2 + cn2 — 2 
n — a„n 2 — cn 2 +1 



(d^ni + mi - 2) - (^!L±f)! + o(n-|), 



where the term 0(n 2) is uniform over c G (0,M]. Using (2.4) in (2.3), we 
have as n — 00, 



~ e 



{n- j - k + 1)! 

and then 

(n-1)! (n - l)""J'~'=+i 

n" (n — j — A; + l)! ne 

Thus, as n — )• 00 



1 1 

1 _i_ >2 „(n— c(,in2 — cn2 -f 1) 
(d„+cjn2 2 2 ^ ^ J = dnn2,k = Cn2. 



V2 



vrn 



1 

~ — e 



(rfn+c)2^ i = dnral. A; = m2. 



(2.5) - ^) / _ ~ - V e-|('^+^)' 



(n — i — k + 1)\ ne ^-^ 

k=2 ' ^ k=2 



20 



ROSS G. PINSKY 



from which it follows that 



(2.6) lim > j '— = - / e'^^'^^y' dy. 

^ ' n^oo n" ^ (n-j-A; + l)! e Jq 

We now consider the second sum, as k runs from [Mna] + 1 to [^n]. For 
X G (0,2], one has log(l + 3;) < x — tox"^. Using this and the fact that 



< 



n'^^-k+i ^ ^' large n, we have for large n. 



log( 



n — 1 



(2.7) 



n — j — k + 1' 



log(l+ + ^ , V )< 



n — J — A; + 1 ' 



J + - 2 
n — J — /c + l 18^n — j — fc + l 



1 ^ i + - 2 



-)^ [Mna] + 1 < /c < [-n]. 



Using (2.7), we have as n — )• 00, 
(2.8) 



(n-1) 



n— j— A;+l 



1 ,„_,_fe+i(n-j-A; + l)"-W 



[n — j — k + 1)\ n — j — k + 1 
(n — j — k + 1) 



{n- j -k + 1)1 



< 



n—j—k+l 



{n- j -k + 1)! 



(^•+fc_2-^(l±^) 

g V-^ 18n — J — + 



< 



(l + o(l)) 



^2TT{n -j-k + 1) 



( . . , „ {j+fe-2)2 N 1 2^ 

1^+*:-^ 18^^;, for [Mn2] + 1 < < [-n]. 



From (2.8), we obtain 

(n-1)! (n - l)"--'-^+i 

(2.9) 



(n — J — k + n e 



for [Mna] + 1 < k < [^^li as n — )• 00. 



Thus, similar to (2.5) and (2.6), we conclude that 
(2.10) 

i(n-l)! 1^ (n - l)"-J'-^+i ^/2 

lim sup n 2 > ; < 

{n-j-k + l)\- e Jm 

k=[Mn1]+l 



n" 



Using (|2^, (|2^, ( |2.10D and (|2JJ), and letting M 00, we conclude that 

1 1 1 1 2 

lim n2p„(id, {cr~"'^(l) = (i„n2}) = - e~^y dy. 
n^oo e 7^ 

To prove the final statement in part (iii), we need to show that 



(2.11) 



00 />oo 



( / e dy)dx = 1. 



Note that F{x) 
N(0,1). Thus 
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n lo ^ '^^ dy is the distribution of \Z\, where Z 



(2.12) - Fi.))d. = E\Z\ = f-[ x^f e-i^^dx = f- 



But 1 - F{x) = J^f^ e-^y dy. Substituting this in gives pUj ) 



Proof of part (i). Now consider the case that j = 6„n with hm„_j.oo bn = b £ 
(0, 1]. As noted above, ^""f^ is increasing for < x < n — 2. Thus, letting 
(5 = I > 0, for sufficiently large n, one has for all k, 



< 



n 



^_^^{l-5)(n-l) ^ 



j-k + l)\ - [(n-l)(l-5)]! ^2^n(l-5)'l-<5 
and then for some constant Cq > 0, 

(n -l)!(n -!)("- W) ^ O, . ^^(i-^)^^)- 
n"^ {n- j - k + ~ n ' ' 

One can check that e^(l — with x G [0, 1) attains its minimum value 

at X = 0, where it equals 1. Thus, for some e > 0, we have 

Co 



(2.13) 



(n-1)!"^^ (n - l)"-i-'=+i ^ 



n" 



k=2 



{n- j -k + l)\ ~ (1 + e)^ 



Using (2.13) along with (2.1), it follows that 



lim np„(id, {ai = 6„n}) = e' 



b-l 



Proof of part (ii).We now consider the case that j = bnU with lim„_!.oo bn = 

1 

and with liminf„_j.oo ':J^^^n > V^- For some e > and large n, we can 
write j = /nna, with /„ > y^2(1 + e) logn and In = 0(77.2). Since ^""^ is 
increasing for 0<x<n — 2, we have for sufficiently large n and all k that 
(2.14) 

(n-l)(»-J-fe+i) ^ (n-1)"-'""^ ^ -1 („_,^„i) e"-'""^ 

(n-j-fc + l)! - n-^„n5 ' 
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We have 



(2.15) (n-/„n2)log(l + 



l„n2 — 1 1 1 2 , 

y) = - 1 - -/„(l + o(l)), as n — ^ oo. 

n — lnn2 ^ 



From ( |2.14[ ) and ( |2.15| ), it follows that for some Ci > 0, 



(n-l)!(n-l)("-J-'=+i) Ci 1,2 Ci 



n" 



{n-j-k + 1)1 



n 



n 



2+e- 



and thus 
(2.16) 



(n-1)! (n - l)("-i-'=+i) 

r,ri / -I 



k=2 



{n- j -k + l)l ~ n^+^' 



< 



□ 



From ( |2.16[ ) with ( |2.1[ ), it follows that 

lim npn{id,{ai = 5„}) = 

3. Proof of Theorem [2] 

We first derive the exact combinatorial formula for Pn(id, {cr„ = j}). Of 
course, Pn(i'i, {cr„ = n}) = K Now consider 1 < j < n — 1. If card number 
j is moved to the k-th position, with j < k < n, then at the end of the 
shuffle it will be in the last position if and only if the following occur. Cards 
numbered 1 to j — 1, which were moved before card number j was moved, 
must all move to the left of card number k + 1 (if k = n, these cards can 
move unrestrictedly). If this occurs, then after card number j is moved to 
position k, the cards numbered 1, • • • ,J — 1 and j + 1, • • • ,k will be to the 
left of card number j. Now cards numbered j + 1, • • • ,k must all move to 
positions smaller or equal to A: — 1 in order that they remain to the left of card 
number j. And then cards numbered /c + 1, • • • ,n must successively move to 
the left of card number j (if k = n, this step is vacuous). We now calculate 
the probability of this occurring. The probability that cards numbered 1 
up to J — 1 move to left of card number A; + 1 is {^y~^- The probability 
that cards numbered j + 1, - ■ ■ ,k, which are all in positions smaller than or 
equal to A: — 1, will all move to positions smaller than or equal to A; — 1 is 
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{^-^)^~^ ■ The probability that cards numbered A; + 1, • • • , n, which occupy 
the positions A; + 1, • • • ,n, move successively to the left of card number j 
which occupies the A;-th position, is HJ^T^^ ^. Thus, conditioned on card 
number j moving to position A;, with j < k < n, the probability that card 
number j will end up in the last position is — ~ ^n"-^' ' Conditioned 
on card number j moving to position k with 1 < A; < j — 1, the above 
considerations show that the probability of it ending up in the last position 
is zero. 

Prom the above considerations and calculations, we conclude that 

(3.1) .»od,K^i})^^^E^^^;fciF' 

which we rewrite in the form 

3.2 p„ id,{a„=j} Yl 

^-^ ^ m ' ml 

m=j-l 

where O'^ and (g)'^ are understood to be 1. Note that the formula is also 
correct for j = n. 

We prove the following estimate. 

Lemma 2. 

, , ^ 1 e" 

(3.3) > — r~ as n oo. 

^ ' ^^rn\ (e-l)V2^V^' 

Proof. We have 

n-1 

m\ -v/27r \frn 



(3.4) — ~ , >^ — as n — )• oo. 

m=l m=l 

Let a{m) = e"^, h{ra) = m~2 and A{m) = J2jLi = ^~^iy^^ for m > 1. 
Recall the following summation by parts formula: 

n— 1 n—2 

a{m)h{m) = ^ ^(m)(6(m) - fe(m + 1)) + A{n - l)b{n - 1). 

m=l m=l 
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Thus we have 

n-l 

(3.5) : 



n.-2 



,m+l 



m 



{e-l)Vn 



6/ 1 



1 



)• 



m=l ^ ' m=l 

Using the mean value theorem, it follows that there exists a C > 0, and for 
any M > 1, a Cm > such that 

n-2 



(3.6) 



"-2 gm+1 



e, 1 



e - 1 Jm Jm 



in=M 



From (3.5) and (3.6) it follows that 

lim "v/ne^" > 

n— >oo ^— ' 



n-l 



(3.7) 



^ -^m e — 1 



Now (|3^ and (|3/7|) give 

lim -^/ne^" > 



n-l 



(3.8) 



m=l 



m 
ml 



1 



(e- 1)V2^ 



□ 



We now consider successively each of the three parts of the theorem. 
Proof of (i). By Lemma [2| it follows that for any e G (0, 1), 



(3.9) 



[(l-e)n]-2 

E 



as n — )• oo; 



m! — ' mi 

m=l m=l 



and thus, from Lemma [2] again we have 

n-l 



(3.10) 



m'" 1 



5 m! (e-l)V2^V^^ 



as n — )• oo. 



m=[(l— e)n] 



Also, max„g|j_;^ ... „_i|(^^^^)-' ^ = (j^)-' ^, and standard analysis shows 
that supj>2(j33;)-'^^ = e. Thus, from (3.9) it follows that 



n-l , jy, n-l 

(3.11) Y(—y-'^- E ( 



m + 1 rri 



m=[(l-e)n]-l 



m 



as n — )• oo. 
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Let j = bnn with lim„_s>oo bn = b G [0, 1). Now substitute for j in (3.11) 
Clearly, 



lim lim inf min ( — -'- — 

e^O ?i->oo me{[(l-e)n]-l,-- ,n-l} m ' 



bn'n—l 



lim lim sup max 

e-5-0 n-s>oo me{[(l-e)n]-l,-- ,n-l} ' 171 



Using this along with (3.10) and (3.11), we conclude that 



(3.12) 



n-l 

E ( 

m=bnn—l 



m 



ml 



{e-l)V2^Vn 



, as n — oo. 



Now (3.12) and (3.2) give 



Pn(id, {an = bnu}) ~ -e""\/27m- — = — = -. 

n (e - l)\/27r V"- ne-1 



as n — )■ oo, 



which proves (i). 

Proof of (a). Let j = bnU with lim„_>oo &n = 1 and \\m.ri^oo{n — bnn) = oo. 
We can rewrite j in the form j = n — jn, where lim„_j.oo In = oo and 



lim„ 



7n 



0. From (3.2) we have 



(3.13) pn{id, {an = bnu}) 



(n-l)! 



n" 



^ rn ' m\ 

r)i=n-7„-l 



For m in the range appearing on the right hand side above, we have 

^n-r m ' -^n--in-l 

and both the left and the right hand sides above converge to e when n — )• oo. 



Thus, from (3.13), we have 



(3.14) pn, {an = bnn]) ~ -e-"\/2 

n 



vrn e 



n-l 

E 

m=n- 7„-l 
n-7n-l 



as n — )• oo. 



ByLemma|2|E:;=\^~ (;ny7I^7^andE:;j{ 
as n — 7- oo. By the assumption on 7„, the order of the latter term is smaller 
than that of the former term; hence from Lemma [2] again, 

n-l 



(3.15) 



1 



X ^ in 

^ m\ ^ (e- l)V27r 

=n-7„-l ^ ' ^ ^ 



as n — )• OO. 
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From (3.14) and (3.15), it follows that 
Pn(id, {o"„ = bnu}) ~ -e""'\/2 



1 e 



iirn e 



n 



(e - l)\/27r \/n ne-1 



, as n — )• oo, 



which proves (ii) 



Proof of (in). Now we let j = n — / with / > fixed. By (3.2), we have 
(3.16) pn{id, {an = n - I}) 
From this, it follows that 



(n- 1)! 



n-l 

E 

m=n—l—l 



(3.17) pn(id, |cr„ = n — /}) ~ — e V27rn e > 

n ^-^ 



r=0 



(n — r — 1)! 



We have ^" j;^ -.^ — ~ as n — t- oo. Thus, from (3.17), we conclude 



(n-r-l)! 



/27rn 



that 
(3.18) 
which proves (iii). 



1 1 e e~' 

p„(id, {(T„ = n - /}) ~ - Ve"'^ = — . 

n n e — I 



r=0 



□ 



4. Proof of Theorem [3] 



Let L,M > 0, with L being an integer. In the calculations that follow, 
we will use the generic P to denote probabilities of events concerning the 

(n) 

shuffling mechanism. Let Bj^y be the event that at least one out of the first 
[Mna] cards (that is, the cards numbered from 1 to [Mn^]) gets removed and 
reinserted in a position that is no greater than [Mn2]. Note that P{B 



l_(l_Ii^)[Ma];SO 



M ) 



(4.1) lim P(si:;)) = 1-e-^^'. 

n— >cxD 

If the event occurs, let j^"^ < [Mnz] denote the number of the card 
with the smallest number that gets removed and reinserted in a position no 
greater than [Mna]. For convenience, we define j'^^ = oo if the event -B^^ 
does not occur; thus, B^^^ = {j^"* < [Mna]}. 
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For L < [Mna] — 1, define C^''^^ to be the event that no more than L 
out of the first [Afn2] cards are removed and reinserted in a position to the 
left of card number 2[Mn2] — L — 1 (by the restriction on L, card number 
2[Mn2] — [L] — 1 is guaranteed not to be among the first [Mnz] cards). 
Prom the definitions, it is easy to see that 

where Xn,M,L ~ Bin([Mn^], 2[Mnij-L-2 ^_ g.^^^ £^X„,m,l, Var(X„,M,L) ~ 
2M^ as n — >■ oo, it follows that 

(4.2) lim lim P(cJ;) ^0 = 1, if L{M) > ZM\ 

We claim that if C^^^ occurs and < [Mnz], then immediately after 

(n) 

card number jj^^ is removed and reinserted, there will be no more than L 
cards with numbers less than jj^^ appearing to the left of card number jj^^ . 
Indeed, assume to the contrary that at least L + 1 cards with numbers less 
than appear to the left of newly reinserted card number . But then 
since c|^''^ has occurred, card number 2[Mn^] — L — 1 is also necessarily 
to the left of newly reinserted card number Since every card with a 

number greater than [Mna] has not yet been removed and reinserted, it 
follow that all these cards maintain their original relative order; thus in fact 
all the cards from [Mna] + 1 up to 2[Mn2] — L — 1 are to the left of newly 
reinserted card number J^"*. We conclude that these [Mnz] — L — 1 cards 
as well as at least L + 1 other cards are to the left of newly inserted card 

(n) 

number jj^ ; but this contradicts the assumption that the position of card 
number is no greater than [Mna]. 

If Jm^ < [Mna], let pos(j^'*) denote its position immediately after it is 
removed and reinserted. For the rest of this paragraph, when we use the 

(n) 

word "now," we mean at the time immediately after card j)^ is removed 
and reinserted. If < [Mna] and has occurred, then immediately 

after card number is removed and reinserted, it will find itself in position 
pos(j^^) < [Mn^], and the number of cards with lower numbers than 
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that will be occupying positions to the left of position pos(j^'') will be 
between and L; call this number L' . All the cards with numbers higher 
than j^"^ will be in their original relative order; thus, pos(j^'') — 1 — L' of 
them will be in positions to the left of pos(j^''), and n— j^^ — pos(j^^) + l+L' 
of them will be in positions to the right of pos(j^'^). Let -D^'*^, denote the 
event that no more than L out of these pos(j^'') — 1 — L' cards that are now 
to the left of card in position pos(j^^) end up to the left of card jj^ 

in) 

after being removed and reinserted, and let E\^'j^ denote the event that no 
more than pL out of these n — — pos(j^^) + 1 + L' cards that are now to 
the right of card in position pos(j^^) end up to the left of card after 
they are finally removed and reinserted, thereby ending the shufHe. Here pL 
is an integer which will be chosen later. 

By looking at the worst case scenario (by choosing L' = and pos(j^^) = 
[Mn^]), it follows easily that 

where y„,M,L ~ Bin([Mn5]-l, IMziEM). Since £;y„,M,L, Var(i;,,M,L) ~ 
as n — )■ oo, it follows that 

Now we consider P(£'^"^^|L'^^^, C^^^, S^^). Conditioned on B^m ^^m'^l 
and D^^j j^, when event D^^^^^ ends and event E^^j^ starts, the card j^^"* will 
be in a position between 1 and 2L + 1; call the position k. Then the worst 
case scenario would be to set n — j^"^ — pos(j^'') + 1 + L' equal to n — fc; 

(n) 

that is, equal to the total number of cards to the right of card j)^ ■ Thus 
a lower bound for C^\, B^^) is the minimum over those k 

between 1 and 2L + 1 of the probability that in a deck of n cards ordered 
from 1 to n, if one removes and randomly reinserts the last n — k cards, 
then no more than pL of them get reinserted to the left of card k. We 
can write these probabilities in terms of certain probabilities for certain 
geometric random variables. For any i > 1, let T* denote a geometric 
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random variable with parameter and with values in {1,2,---}, and let 
Tg. and Tq. be independent for j ^ i. For a fixed k, the above probability 
is -P(X]fio-^^ ^ n — k). To see this, think of the number of cards that 

n 

are removed and randomly reinserted until the first time one of them gets 
placed to the left of card number k as a.T\ random variable, think of the 

n 

number of cards after the first one gets placed to the left of card number j 
until a second one gets placed to the left of card number j as a T1^^ random 

n 

variable, etc. (In fact, these numbers are not distributed according to these 
random variables, because there are only a finite number of cards. What is 
true precisely, for example, with regard to the first time a card gets placed 
to the left of card number k is that for I < n — k, the probability of needing 
exactly / cards to be removed and reinserted until the first time one of them 
gets placed to the left of card number k is equal to the probability that Tl 

n 

is equal to 
So we have 

pL 

r.("-) I nW r'W r(")) ^ ^^^^^^ ^ I 

~ l<yk<2L+l 

1=0 

Now for all < A: < 2L + 1, 

1 ^ 1 k + pL + 1 2L + 2 + PL 

E^T,^=n^—> nlog > nlog , 

«=0 1=0 

and 

pL 

Var(y Tfc+i) < Ct?, 

1=0 

for a constant C independent of k and L. Thus, by Chebyshev's inequality, 
for any A(L), 

(4.5) P(g%>"log^^^^-nA(I))>l-^. 



(4.4) P(EgjDg^, Cgi, <) > min^^ P(Y^ T.^>„-k). 



Choosing now p in the definition of i sufficiently large so that log '^^2L+i^ 
2, and letting A(L) = \ log "^^21+1^ ' follows from ([OJ) and ([45j) that 

(4.6) hm lim P(4t C^, B^^^) = 1. 

L— >-oo n— >oo ' ' ' 



> 
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If events B^^\ C^ml^ ^A4L ^^'^ occur, then at the end of the shuffle, 

card number < [Mna] will end up in a position between 1 and 2L + 



pL + 1. Thus, by (4.1)-(4.3) and (4.6), we conclude that (1.7) holds. 



1 

Finally, we have Un{Aj^ j^) = 1 — -^^ — jiU — -, from which it follows that 



limn,-5.oo Un{A^^ji) = 0. This in conjunction with (1.7) proves (1.8). □ 



5. Proofs of Theorem [4] and Corollaries [3| [4] and [5] 

Proof of Theorem^ Let 6„ satisfy lim„_i.oo bn = b £ [0, 1] with 6„n an in- 
teger, and let dn satisfy lim^-^oo c^n = d £ [0,1], with an integer. As 
in the proof of Theorem [3j we use the generic P to denote probabilities of 
events concerning the shuffling mechanism. Let Qi^\ (x), < x < 1, denote 
the rescaled distribution function of cr^^^^ under p„(id, •), when conditioned 
on card bnn having been removed and reinserted in position that is 
Qb!^d„i^) ~ Pni.^'^j ^b^n — '^a^lcard bnn was reinserted in position dnu). Let 
Gb{y) be as in the statement of the theorem. We will show that the dis- 
tribution Qb^dn^^^) corresponding to the distribution function Qi^d„^^) 
converges weakly to the (5-measure at Gh{d): 

(5.1) w - Jim gg^^ (dx) = Sa.id)- 

It is easy to check that the function Gh{y) = e^^"^^*^ — (1 — y)e^~^ is 
increasing in y G [0, 1]. Thus, since the probability that card 6„n is inserted 
in a position no larger than (i„n is d^ it follows that Fb{Gb{d)) = d; that is, 
Gb = ■ Thus, to complete the proof of the theorem, we need to prove 



(5.1) 



For notational convenience, we will sometimes write j = bnJi and k = 
dnU. After card number j is removed and reinserted in position k, a certain 
number of cards from among those with numbers less than j (which were 
removed and reinserted before j was) will be to the left of newly reinserted 
card number j. Denote this random number of cards by M. Of course 
then, the other cards to the left of newly reinserted card number j are the 



CARD-CYCLIC TO RANDOM SHUFFLE 31 

cards j + 1, - ■ ■ , j + k — 1 — M. These cards are the next to be removed and 
reinserted. Let R denote the random number of cards out of these k — l — M 
cards that end up to the left of card number j. So now card j is in position 
M + R + 1. Now it is the turn of the remaining n — j — k + M+1 cards, 
with numbers from j + k — M up to n, all of which are to the right of card 
number j, to be removed and reinserted. Let S denote the random number 
of cards out of these cards that end up to the left of card number j. Then 
at the end of the shuffle, card number j will be in position M + R + S + 1. 

We will show that as n — )• oo, the distribution of ^ converges to '^7(6,^), 
where 



(5.2) 7 = -f{b,d) 



b-{l-d){l-e-^), if > 1 - (1 - 6)e''; 
d, if d < 1 - (1 - b)eK 



We will show that as n — )• 00, the distribution of ^ converges to '^i-'y-(i_d)e<i-7 • 
Let t = t(7, d) = 1 — 7 — (1 — (i)e'^~'^. We will show that as n — )• 00, the distri- 
bution of ^ converges to S(^+t){e'^-''-''-+-i-i)- Thus qI^^^, the rescaled distri- 
bution of the final position of card j , namely, the distribution of '^'^'^^^^^^ , 
will converge to 5^_^-l._^(^^_^_^^(^^l-b~d+', _iy Using the equations above to write 
everything only in terms of b and d, we obtain 



7+t+(7+i)(e'~''"'+^-l 



de^'\ if d < 1 - (1 - b)e^; 

^{i-d)e-b _ (1 _ c[)e^-b^ if d > 1 - (1 - h)e\ 



thus giving (5.1 ). 



We now prove the claims in the above paragraph regarding the distribu- 
tions of — , ^ and ^. We start with — . A careful analysis of the shuffle up 
until the time that card number j is removed and reinserted in position k 
will reveal that if j < A; and < m < j — 1, or if A; < j and < m < /c — 2, 
then the random variable M will be equal to m if and only if at least m 
cards from among the first j — 1 cards were inserted to the left of card num- 
ber j + k — m, and at most m cards from among the first j — 1 cards were 
inserted to the left of card number j + k — m — 1. However if A; < j and 
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m = k — 1, then the random variable M will be equal to m = /c — 1 if and 
only if at least m = k — 1 out of the first j — 1 cards were inserted to the 
left of card number j + 1. 

We can write the probabilities of the events described above in terms 
of certain probabilities for certain geometric random variables. For any 
i > 1, let Tg. denote a geometric random variable with parameter qi and 
with values in {1, 2, • • • }, and let T*. and Tq^ be independent for j ^ i. Let 
^n,j,k;m denote the event that at least m cards from among the first j — 1 
cards were inserted to the left of card number j + k — m (with m in the 
range noted above). Then 

j-m 

(5.3) P(^nj,fc;m) = P{Y. K ^+^ — ' > i - !)• 

The explanation for this is similar to that given at the point in the proof of 
Theorem |3] where geometric random variables were introduced. (Think of 
the number of cards that are removed and reinserted until the first time one 
of them gets placed to the right of card number j + A: — m as a j+u-m-i 

n 

random variable, think of the number of cards that are removed and rein- 
serted after the first one gets placed to the right of card number j + k — m 
until a second one gets placed to the right of card number j + A; — m as a 
T"^ j+k-m-2 5 etc., with the same caveat as noted in the proof of Theorem jsj) 
Letting Bnj^k;m denote the event that at most m cards from among the 
first j — 1 cards were inserted to the left of card number j + k — m — 1 (with 
m in the range noted above), we have similarly 

j-m-l 

(5.4) P{Bn,j,k;m) = H Yl ^[-2+^^ < i " !)• 

(=1 

For k < j, letting Cnj^k denote the event that at least k — 1 out of the first 
j — 1 cards were inserted to the left of card number j ' + 1, we have similarly 

j-k 

(5.5) P{Cn,j,k) = P{Y.T[_,_^ > J - 1). 

1=0 
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Recall that j = bnn and k = dnn. Write m in the form m 



Inn 



and assume that 7 = lim„_!>oo 7n exists. By the restrictions on m, we can 
assume that 6 > 7. Then, by the law of large numbers if 6 > 7, and trivially 
if 5 = 7, it follows that ^ YlilZT j+k-m-i converges almost surely to its 

n 

limiting mean value. The mean of the sum is ^ X]l="i ^ 
thus the limiting mean value is 







1 



dx 



l-fe„-c(„+7„-|-i 

logOTF- On the 



other hand, lim„ 



h. Thus, we conclude from (5.3) that 



(5.6) 



lim P(Aj,fc;r 



1, if logT4^>6: 



0, if log 



6+7 
6+7 ^ 



Making the same type of argument for (5.4) and (5.5), we obtain 
(5.7) lim P{Bn,j,k;m) -- 



1, if log 3^ 



1-^ < h- 



0, if log 



l-d 



-fc+7 



>b, 



and 



(5.8) 



lim P{C, 



n,j,k ) 



1, if log^E^ >5; 
0, if log 'jEi<b. 
Consider first the case that j < k. Recalling that M = m 



'-fniT- occurs if 



and only if Anj^k;m and Bnj^k-^m occur, it follows from (5.6) and (5.7) that 
the distribution of ^ converges to the J-measure at the 7 which solves the 



equation log 



l~d 



-6+7 



b. The solution is 7 = 6 — (1 — (i)(l — e ^). 



Now consider the case that k < j. Note that in this case, m < k — 1, which 
means that necessarily 7 < d. First consider the case < m < k — 2. Since 
M = m = 7^72 occurs if and only if Anj^k;m and Bnj,k;m occur, we again 
conclude that ^ converges to the (5-measure at 7 = 6 — (1 — (i)(l — e~^), as 
long as the right hand side is indeed no greater than d. One finds that the 
right hand side is no greater than d if and only if d > 1 — (1 — 6)e^. If the 
opposite inequality holds, then we could conclude by process of elimination 
that ^ converges to the 5-measure at 7 = d. However, working directly, 
we recall that M = k — 1 occurs if and only if Cnj,k occurs. Solving the 
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inequality log > b gives d < 1 — {1 — b)e^; thus, we conclude from (5.8) 
that ^ converges to the (5-measure at 7 = d if d < 1 — {1 — b)e^. This 
completes the proof that the distribution of ^ converges to S-y(b,d)^ where 
7(6, d) is given by (5.2). 

Now we turn to the distribution of ^. Recall that as we begin to imple- 
ment the random variable R, card number j is in position k, to the left of 
card number j are M cards that have already been removed and reinserted, 
as well as k — M — 1 cards that are now to be removed and reinserted. The 
random variable R is the number of these k — M — 1 cards that end up to 
the left of card number j. Using geometric random variables, similar to the 
case for the random variable M, we have 

„ k—Xn—l~tn 

P{- <t\M = \n)=P{ V T[_k^<k-\n-l). 

1=1 

By the law of large numbers if d > A + t, and trivially if d = A + t, it 
follows that ^ ^fc-An-i-in j,i converges almost surely to its limiting 

mean value, which is Jq i-d+x '^'^ ~ log ""^Y-d* - other hand 

lim„_!.oo ^^^^^^ = d — \. Thus, we conclude that 



P(- < t\M = An) 
n 



1, if logi^ <(i-A; 
0, if log >d-X. 

This proves that the distribution of ^, conditioned on M = An, converges to 
the (^-measure at the t = t(A, d) which solves the equation log = d — X. 

The solution is t{X,d) = 1 — A — (1 — d)e'^~^. Since the distribution of 



^ converges to the (5-measure at 7 = -y{b,d) given in (5.2), and since the 
distribution of — , conditioned on — = 7, converges to the (5-measure at 
t(7, d) = l — -j — {l — d)e'^~^, we conclude that the distribution of ^ converges 
to the (^-measure ai t = ^(7, d) = 1 — 7 — (1 — d)e'^~'^ , with 7 = 7(6, d). 

We now turn to the distribution of ^. Recall that as we begin to imple- 
ment the random variable S, card number j is in position M -|- i? -|- 1, and 
there are n — j — k + M + 1 cards, all to the right of card number j, which 
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need to be removed and reinserted. The random variable S is the number 
of these n — j — k + M + 1 cards that end up to the left of card j. Using 
geometric random variables again, we have 

Q vn+1 

P(- < v\M = An, i? = /xn) = P( V r(, , > n - j - k + \n + 1). 

1=1 

By the law of large numbers if v > 0, and trivially if f = 0, it follows that 
n X]r=i^^ -^A+zi-f ' converges almost surely to its limiting mean value, which 
is x4^dx = log^ig^. On the other hand, lim^^o, n-,-k+Xn+i 
b — d + X. Thus, we conclude that 



S 

Pi- < v\M = Xn,R = fin) 
n 



\, if log^±g^>l-5-d + A; 
0, if log^±i^<l-5-d + A. 



This proves that the distribution of ^, conditioned on M = An and R = fm, 
converges to the 5-measure at the v = v{X, fi) which solves the equation 
log^X+? = ^-b-d+X. The solution is V = v{X,fi,b,d) = (A+/i)(e^-*-°'+^- 
1). Since the distribution of ^ converges to the J-measure at 7 = j{b,d), 
and since the distribution of ^ converges to the 5-measure at t = t{'j,d), it 
follows that the distribution of ^ converges to the 5-measure at v{'j, t, b, d) = 
(7 + t)(ei-^-°'+T - 1), with 7 = 7(6, d) and t = t{-f, d). □ 

Proof of Corollary The proof of Theorem |4] shows that with regard to 
the position of a particular card at the end of the shuffle, the only random- 
ness that remains when n — )• 00 is the randomness incurred by removing 
and reinserting that particular card, and not the randomness incurred by 
removing and reinserting other cards. Furthermore, as is clear intuitively 
and also from the above proof, a finite number of changes with regard to 
the positions of other cards does not change the limiting distribution of the 
card in question. The corollary follows from these facts. □ 

Proof of Corollary^ First we prove part (i). Since P(E^^_^ < S^^^) = ^, to 
prove part (i) it suffices to show that — ^ ^di^ '^''"^^ \b2=bi= ~ bi)e^^ — ^. 
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(5.9) 



'0<x<y<l 

From the equation Gb{Fh{x)) = x, we obtain 



fbi{x)fb2{y)dydx = / fb^{x){l - Fb^{x))dx. 



db ^ > G[{Fb{x)) ■ 



Differentiating ( |5.9| ) with respect to 62 and using the above equation along 
with the fact that fb{x) = -Twr^r-r::^ , we have 



dho 



Ife2=fel = 



1^1.=., {Fb^x)) 



dx. 



G',^{Fb,{x))^ 

Making the substitution x = Gb^ (y) in the above equation, we obtain 



(5.10) 



b2' 



dho 



1 dGb 



^ \b=b, jy) 
G'bSv) 



dy. 



Recalling the definition of Gb from Theorem |4j we have 

dGb ^ 
db 



-ye- 

(1 - y) (e^-" 



< y < 1 - (1 - 6)6^ 
e~beii-y)e~''^ , 1 - (1 - 6)e^ < y < 1, 



and 



G'biy) 



.l-b 



^l-b _ ^-b^{l^y)e- 



< y < 1 - (1 - 6)e^ 

1 - (1 - b)e^ < y < 1. 



Note then that the quotient 



(y) 



reduces to — y onO<y< 1 — (1 — 
6i)e*S and reduces to (1 — y) on 1 — (1 — bi)e^^ < y < 0. Thus, from (5.10), 
we obtain 



62^ 



db2 



\b2=br 



l-(l-6i)e6 



ydy + 



l-(l-bl)e''l 



(1 - y)dy 



{I - b,)e''^ - l- 

Now we prove part (ii). Recall that fi{x) = 1. Thus, 



P(s-j < S^j) = / 
Jo 



fb{x)dydx 



0<x<y<i 



{l-x)fb{x)dx=l- E{b), 
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where E{b) is as in Corollary [2j Furthermore, from that corollary, it follows 
that E{b) > i for 6 G (6,1) and E{b) < i, for 6 G [0,6), where 6 is the 
unique 6 G [0, 1) for which E{b) = ^- □ 

Proof of Corollary^ Since hx{b) = fb{x), the statements regarding /io(6) 
and hi{b) as well as (iii) and (iv) follow from Corollary [l] and the definition 
of bx- For part (i), we have fo{x) = and Go(y) = e - e^^^. Note 

that Go{y) and Xf, are the same function (one of y and one of 6). Thus, 
hxiO) = fo{x) = = f^. 

The proof of part (ii) requires long, tedious calculations. One begins by 
differentiating the equation Gi,{Fi){x)) = x with respect to 6, thus obtaining 
"^^j^^^ = — /'T-i /^!^ ■ Differentiating this new equation with respect to x, 
one obtains 



(5.11) 



^iG-'(xy)G-(G-\x)) dG^ 1 . 
dfbix) _ G',iG-Hx)) db i^b W) 



db iG',iG^\xW 
Using the formulas for G^ = Gb{y) and its derivatives in the range 1 — (1 — 
b)e^ < y < 1, substituting in (5.11) and making a number of cancelations, 
one obtains 

^ db - {G',[G-,\xW 

This shows that the density hx{b) = fh{x) is increasing for < 6 < 6^;. 



Differentiating (5.12) with respect to 6, and again using the formulas for 
Gfe = Gb{y) and its derivatives in the range 1 — (1 — 6)e'' < y < 1, and 
making a lot of cancelations, one finally arrives at the formula 

d^fbjx) _ 6-3^(6 -e(^-^"W)^"'')=^ 
db' ~ {G',{G^\xW 
This shows that the density hx{b) = fb{x) is convex for < 6 < 6^. □ 

6. Proof of Theorem [5] 

Proof of Theorem^ To prove the theorem, we will need to consider a related 
shuffle. Fix two (not necessarily distinct) permutations cr, r G 5„. Start the 
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deck from a and then use r in the following manner to remove and randomly 
reinsert each card exactly once: for each j = 1, • • • ,n, the j-th card to be 
removed and randomly reinserted is the card with the number tj on it. 
Let •) denote the resulting distribution. (Note that in terms of these 

shuffles, we have Pni^, •) = •); in particular, Pn(id, •) = p"^(id, •).) Let 
id°''P denote the permutation in Sn satisfying id°^'' = n — j + 1, j = 1, - ■ ■ ,n. 
Note then that Pn°^^ (f) id) is the probability of ending up with the identity 
permutation, if one starts from a and removes and reinserts the cards one 
by one, in the order n, n — 1, • • • ,1. 

There are n" possible ways to implement the Pn(id, •) card-cyclic to ran- 
dom insertion shuffle since each of the n cards is removed once and reinserted 
in one of n positions. The number of ways that result in the permutation 
a is thus n^pn{id,a). By "undoing" any such way, we get a one to one 
correspondence between the ways of going from id to a using our original 
shuffle, which removes and reinserts the cards in the order 1, 2, • • • , n, and 
the ways of going from a to id using the shuffle which removes and reinserts 
the cards in the order n, n — 1, • • • ,1. Thus, we conclude that 

(6.1) pn{id,a)=pf{a,id). 

We will now calculate pjf {c, id). The cards begin in the order a. Card 
number n is removed first and randomly reinserted, then card number n — 1, 
etc. There are different ways of implementing this, and we need to know 
how many of these ways will result in the cards ending up in the order id. 
For any such way, we construct a path {Wj}'^^^ as follows. For each j £ [n], 
let Wj denote the position in which card number j was inserted. It is clear 
that if the cards are to end up in the order id, then we need Wj < Wj+i 
for all j. However sometimes this is not enough and we will need instead 
Wj < Wj+i. To see when we only need Wj < Wj+i and when we need 
Wj < Wj-\-i, consider the state of the cards after the cards numbered n 
down to n — j + 1 have been reinserted in such a way that they appear in 
increasing order from left to right. The current position of card number 
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n — j + 1 is by definition Wn-j+i- To the right of position Wn-j+i one finds 
all the cards numbered n down to n — j + 2. If card number n — j is also 
to the right of position Wn-j+i, then when it is removed and reinserted in 
a position which we call Wn-j, it will find itself to the left of card number 
n — J + 1 if and only if Wn-j < Wn-j+i- However, if card number n — j 
is to the left of position W„-j+i; then when it is removed and reinserted in 
a position which we call Wn-j, it will find itself to the left of card number 
n — j + 1 if and only if Wn~j < Wn~j+i ■ 

Now given Wn-j+i, in fact we know to which side of Wn-j+i card number 
n—j is to be found. Recall that In~j{cr) is the number of inversions involving 
card number n — j and a card with a lower number. Since none of the cards 
with a number lower than or equal to n — j have been moved yet, it follows 
that these In-j{o') cards are to the right of card number n — j, Furthermore, 
as noted, all of the cards numbered from n down to n — j + 2 are in positions 
to the right of Wn-j+i, and card number n — j + 1 is in position Wn-j+i- 
Prom this is follows that card number n — j will find itself to the left of 
position Wn-j+i if and only if {n — j — 1 — In-j{cr)) + 1 < Wn-j+i — 1, or 
equivalently if and only if n — j — In-jicr) < Wn-j+i- 

So we conclude that in order for the cards to end up in order id, it is 
necessary and sufficient that {W^n-j}"=o satisfy Wn-j < Wn-j+i, with strict 
inequality holding if n— j — /„_j(cj) < Wn-j+i- By induction starting with 
n and descending, it follows that Wn-j < n — j, for all j = 0, • • • , n — 1; in 
particular, Wi = 1. 

Now define Yj = n + 1 — Wn-j+i, j = 1, • ' ' ) ^- We have Yj < Ij+i. 
In terms of in order for the cards to end up in order id, it is 

necessary and sufficient that {Y^}"^^ satisfy Yj < Ij+i, with strict inequality 
holding if Yj < j + In-j = lj{o'). We have thus established a one-to-one 
correspondence between the number of ways of implementing the shuffle 
according to pJ^°^^((T, •) and ending up with the cards in the order id, and the 
number of nondecreasing l{a)-path.s of length n. The number of such paths 
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has been denoted by Nn{l{o-)); thus we conclude that p^^°^^ {a, id) 
and by (6.1), we also have Pn{id,a) = '^"^jf^^ . 



□ 



7. Proof of Theorem [6] 

Since we know that Nn{l) is strictly monotone in /, it suffices to show 
that iV„(n ,n-l) = 2"-i and that iV„(l, 2, • • • ,n) = ^(2^"). 

For k £ [n], there is a one-to-one correspondence between paths {Zi}^^^ 
satisfying 1 < Zi < Z2 < • • • < = n and solutions (ai,--- ,ak) with 
positive integral entries to Yli=i — "^^ '^^^ correspondence is given by 
ai = Z\ and a,, = Zj — for i = 2, • • • , A;. As is well known, the number 

of such solutions is (^Zi) [2]- Now a path {y^jf^]^ is a nondecreasing l- 
path of length n with / = (n — 1, • • • , n — 1) if and only if there exists a 
k € [n] such that Yj = n for j > k and such that 1 < < • • • < For 
any fixed k the number of such paths was just shown to be i^Zi)- Thus 

Ar„(/-l,...,/-l) = ELi (rD=2"-^- 

We claim that for / = (l,2,---,n — 1), there is a one-to-one correspon- 
dence between nondecreasing /-paths of length n and Dyck paths of length 
2n. Recall that a Dyck path of length 2n is a path {Zj}?"g satisfying 
Zq = Z2n = 0, > and |Zj — Zj_i| = 1, for all j E [2n]. As is well 
known the Catalan number C„ = gives the number of such Dyck 

paths pOj. It remains to show the correspondence. A Dyck path can be 
represented as a string of 2n bits, n of which are labeled H and n of which 
are labeled T, and such that starting to count from the left, at no interme- 
diate stage are there fewer H^s than T's. Let {Yi}"^]^ be a nondecreasing 
Z-path of length n corresponding to / = (1,2,-- - ,n — 1). Now we map this 
path to the Dyck path which begins with Yi consecutive -ff's, then has one 
T, then has Y2 — Yi consecutive H^s, then one T, then I3 — I2 consecutive 
-fT's, then one T, and continues in this way until ending with Yn — Yn^i 
consecutive iJ's and one T. Recalling that by definition, Yi > i and that 
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Yi^i is allowed to be equal to Yi whenever Yi > i, it is easy to see that this 
gives the appropriate one-to-one correspondence. □ 
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